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(54) Scanner, printer, memory medium and image processing method 



(57) There is provided an environment where a 
specified image cannot be obtained, by providing the 
scanner or the input device with a function of judging the 
specified iniage. 

A scan command is given to a scanner (scanner 
operating command in Fig. 1). then the image corre- 
sponding to the image signal obtained from the scanner 
in response to the command is judged whether it repre- 
sents a specified image (forgery judging module in Fig. 
1), and the result of such judgment is oulputted for use 
in processing the image signal (result of forgery judg- 
ment in Fig. 1). 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[00011 The present Invention relates to a scanner, a 
printer, a memory medum and an image processing 
method. 

Related Background Art 

10002] As a result of recent improvement in the per- 
formance of the c»Ior image reading device utilizing 
CCD or the like (such device being hereinafter called 
color scanner) and of the color printer, there is increas- 
ing danger of forging or unlawful reproduction of an orig- 
inal of which reproduction is. fortjidden, such as a 
banknote or a valuable security document, reading 
such original by the color scanner as the image data 
and printing such image data by the color printer. In 
order to prevent such forging, the color copying appara- 
tus consisting of a color scanner and a cotor printer 
often incorporates a forgo-y preventing device which 
inhitMts the copying operation by recognizing the origi- 
nal of which reproduction is forbidden. 
[00031 However, the forgery preventing device 
employed in the color copying apparatus functions only 
m the copying operation, and. if the original forbidden for 
reproduction is once read by a color scanner, the 
obtained data can be outputted by a color copying 
apparatus or another color printer through a controller, 
so that the original is eventually forged. 



conjunction vwth the accompanying drawings 
BRIEF DESCRIPTION OF THE DRAWINGS 
5 [00091 



Fig. 1 is a view showing the configuration of an 
embodiment of the present invention; 
Fig. 2 Is a view showing an example of the configu- 
ration of a first embodiment; 
Fig. 3 is a flow chart showing the function of an 
embodiment of the present invention; 
Fig. 4 is a view showing the configuration of a scan- 
ner system including a host computer; 
Fig. 5 is a view showing an exanple of the configu- 
ration of second and third embodiments; 
Fig. 6 is a flow chart showing the function of a sec- 
ond embodiment; 

Fig. 7 is a view showing an example of tfie image of 
enquiry to the user in response to an image input 
forbidden for copying; 

Fig. 8 is a view showing an example of the history 
of operation on an image input forbidden for copy- 
ing; 

Fig. 9 is a flow chart showing the sequence of a for- 
gery preventing process; and 
Fig. 10 is a view showing the configuration of a 
printer system. 
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30 DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 



SUMMARY OF THE INVENTION 

[00041 In consideration of the foregoing, an object 
of the present invention Is to provide a configuration 
capable of suppressing the forgery operation for the 
image input from a color scanner or the image output to 
a color printer. 

[0005] The atxwe-mentioned object can be 
attained, according to a prefenred embodiment of the 
present invention, by a printer driver cgpaWe of receiv- 
ing an instruction for tfie printing process, discriminating 
whether an image developed by a rasterizer repre- 
sented a specified (specific) image in response to the 
instruction for the printing process, and outputting the 
result of the discrimination for use in processing the sig- 
nal of the image. 

[00061 Another object of the present invention is to 
provide a configuration capable of efficient prevention of 
forgery. 

[00071 Still another object of tfie present invention is 
to provide novel functions. 

[00081 Still other objects of tiie present invention, 
and the features thereof, will become fully apparent 
from the following detailed description, to be taken in 



[001 0] Rg. 1 is a view showing the configuration of 
a scanner system including a host conputer and consti- 
35 tuting an embodiment of the present invention. On the 
host computer, there functions an operating system 1 02 
(hereinafter written as OS), and a scanner operating 
application 101 functioning thereon provides an operat- 
ing environment for example for an image reading oper- 
40 ation off a scanner 104. 

[001 11 The scanner system shown in Fig. 1 is real- 
ized by a hardware configuration shown in Fig. 2. 
wherein the scanner system is composed of a host 
computer 21 and a scanner 22. The host conputer 21 Is 
45 provided with a monitor 201 for displaying GUI of the 
application 101 and the result of image reading from the 
scanner; a mouse 202 and a keyboanJ 203 for transmit- 
ting the irput by the user to the application and tfie OS; 
an HDD 208 for storing various programs and image 
50 data: a ROM 206 for storing the basic program of the 
host computer; a RAM 205 for storing read programs 
and images; and a scanner l/F 207 for controlling the 
scanner 22. which are mutually connected by an inter- 
nal bus 209 and controlled by a CPU 204. 
55 [P0121 On the host computer 21 of the above- 
described configuration, tfie OS and the application 
realize the following processes by the execution, by the 
CPU 204, of the program read from the HDD 208 to the 
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RAM 205. 

[0013] In the following there wQI be explained the 
internal structure of the OS within an extent necessary 
for explaining the present enrixxfiment. In most OS. like 
UNIX, there are separately realized a device driver for s 
Interfacing with the hardware such as the scanner, and 
a nnodule for managing other user applications and the 
menrory. The present embodiment will be explained in 
the following by an OS having such separate structure 
[0014] The OS 102 is provided, as a nrodule for 
controlling the scanner In addition to controlling the user 
input and other hardware devices, with a scanner driver 
103. which, in the preserrt embodiment, is provided with 
a scanner control nvxlule 103-1 for directly controlling 
the scanner 104 and a forgery judging module 103-2 for 
judging whether the Image fetched from the scanner is 
forbidden for reproduction. The OS is further provided 
with a memory management module 105 for n^naging 
the image data area. 

[0015] The scanner operating application 101 is 
composed for exanple of a GUI routine for interfacing 
with the user, a routine for Interpreting the user input 
received through the OS 102 and issuing a command 
for operating the scanner, a routine for displaying the 
image read from the scanner; a routine for storing the 
read image on the HDD etc. Such GUI Is displayed on 
the monita 201. and various user inputs, for example 
starting the scanning operation, are entered by tiie 
mouse 202 and the keyboard 203. 
[0016] The scanner 104 scans and electronically 
reads an original, placed on an original tafcrfe. by a CCD 
line sensor according to a scanner operation signal from 
the scanner driver, and sends an image signal to the 
host computer according to a predetermined internee 
rule. The image signal is divided Into plural color com- 
ponents, for example R. G and B, each being multi- 
value data of 8 to 12 bits. 

[0017] In the following there will be explained in 
detail the function of the present embodiment of the 
above-described configuration, with refererice to the 
attached drawings. Rg. 3 shows an example of tiie 
operation sequence of the scanner system, on the mod- 
ules of scanner operating application, OS and scanner 
driver. 

[0018] When the user Instructs a scan start opera- 
tion through the scanner operating application by a 
manual operation with the mouse/keyboard on the GUI. 
the scanner initiates the image reading. When tiie appli- 
cation starts tiie reading operation, the application 
secures, on the RAM. an area for the designated image 
to be read in a step S301 . then Issues an image reading 
command specifying the scanner to the OS in a step 
S302. and then enters a waiting state until an image 
reading end notice Is received In a step S303. 
[001 9] In response to the scan start command, tiie 
OS calls. In a step S31 1 . a scanner control nxxiule cor- 
responding to tiie specified scanner, then Issues a com- 
mand for Image reading from the scanner, and enters a 



waiting state until the process of the scanner driver Is 
terminated. In tiiis operation, tiie forgery preventing 
module of tiie OS pr^res. as a variable, a judgment 
rate r^esenting whettier the image data are of an orig- 
inal forbidden for reproduction, and assumes a negative 
initial value for the variabla 

[0020] In response to tiie scan start command from 
the OS. the scanner control module in the scanner 
driver provides, in a step S321 . tiie scanner with a scan 
start command specific to such scanner. 
[0021] In a step 8322, after image reading, the 
image signal received from the scanner is stored in tiie 
image data area secured by tiie application on tiie 
RAM, and the sequence is transferred to the forgery 
judgment module. 

[0022] The forgery judgment module is provided, as 
a tenrplate. with a reproduction forbidden pattem on a 
memory (RAM or ROM) separate from the image mem- 
ory. A step S323 executes pattem matching between 
the stored image data arxi the template, and outputs a 
judgment rate of a value between 0 and 100. An exam- 
ple of such pattern matching consists of calculating the 
mutual correlation between the image data and the tem- 
plate for each color conrponent and outputting the max- 
imum value of the correlations obtained for the different 
color components, but tiie metiiod of such pattern 
matching is not particularly restricted. 
[0023] Also tiie tenplate for the reproduction fbrtNd- 
den pattem may be provided in plural units, and, in such 
case, tiie pattem matching is conducted between tiie 
image data and tiie plural patterns and the obtained 
maximum value can be outputted. In tiie foregoing, the 
forgery preventing module has been explained as a 
software module, but it may also be realized t>y a hard- 
ware for faster processing. Also in case of the process 
with the software nxxtule. tiie process time can be 
shortened for example by (1) preparing a spatially 
skipped (thinned) image signal from tiie stored image 
signal and executing judgment by the atxive-mentioned 
forgery judgment module on such skipped image signal, 
or (2) reducing the number of bits of tiie stored image 
signal for example from 8 bits to 5 t>rt5 and executing 
judgment by the above-mentioned forgery judgment 
module on the image signal with thus reduced nun^r 
of bits. 

[0024] After the Image data reading and the forgery 
judging process, the scanner driver Informs the OS of 
the end of process and returns the judgment rate 
thereto. The OS receives the notice for the end of proc- 
ess from the scanner driver in a step S312. and checks, 
in a step S313, the sign of the judgment rate returned 
from the scanner driver. A negative sign indicates that 
the judgment rate remains as the aforementioned initial 
value, so tiiat tiie scanner driver does not execute the 
forgery judgment process or that the scanna- driver is 
ncd equipped with the forgery judgment process. In such 
case, the image data may be of an original forbidden for 
reproduction, so that a step S315 destroys the image 
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data for example by blackout of the image data area 
(conversion to black data). Otherwise, for a stricter 
measure, the image data area is for example opened by 
the memory management module to refuse the image 
data reception by the OS. 

10025] On the other hand, a positive sign indicates 
that the scanner driver has executed the forgery judg- 
ment process, so that the sequence proceeds to a step 
S314, which discriminates whether the image data are 
of an image forbidden for reproduction by an actual for- 
gery judgment process. It the judgment rate is larger 
than a threshold value set in advance by the OS, the 
image data are regarded as an image forbidden for 
reproduction, and a step S315 destroys the image data. 
[0026] It is also possible to set plural threshold val- 
ues l>y the OS and to vary the measure to be taken 
according to the magnitude of the judgment rate. For 
example if the judgment rate, ranging from 0 to 100, is 
larger than a threshold value 95. the image data can be 
almost certainly an image forbidden for reproduction 
aixl the image data area is opened. This results in a 
strict measure that the application is forcedly closed. In 
such case it is necessary to inform the user of the rea- 
son for such forced closing off the appfication, there is 
given, on the monitor 201. a GUI dsplay indicafing that 
the application is closed by an illegal use and the appli- 
cation is thereafter closed. Also in case the judgment 
rate is larger than a threshoW value 80 but smaller than 
95. there can be conceived a measure of blacking out 
the image. Also in such case, there is given, on the 
monitor 201. a GUI display indicating the reason of 
image black-out After the judgment of the step S31 4 or 
the process of the step S315 by the OS, a step S316 
sends a notice for the end of process to the application, 
whereupon the image reading operation of the scanner 
system is terminated. 

[0027] In the present embodiment, as explaned in 
the foregoing, in acquiring the image signal by the scan- 
ner, there is judged the similarity between the obtained 
image signal and a specified image (image correspond- - 
ing to a banknote or a valuable security document), and, 
in case of a high similarity (high judgment rate), the 
image signal is destroyed or the appfication is closed 
according to the result of such judgment, whereby pre- 
vented is the acquisition of a specified image for which < 
the image formation is prohibited. 
[0028] Also by executing the above^escribed judg- 
ment at the Image signal scanning at the nK>st upstream 
part in the sequence from the scanner through the host 
computer to the printer, there can be securely prevented s 
the acquisition of the image signal, for which the image 
formation is prohibited, in a system consisting of a scan- 
ner, a host computer for image editing and a printer for 
image fbnmatfon. 

[0029] Also in case there is connected a printer not s 
equipped with the function off judging a specified image, 
there can be securely prevented the printing of the 
image signal, corresponding to the image for which the 



image formation is prohibited, by provkling the scanner 
driver or the OS with such function of judging the sped- 
f ied image. 

[0030] The foregoing embodiments executes judg- 
5 ment on the image signal obtained from the scanner 
driver and the OS. 

[0031] However, in the configuration executing the 
judgment of the specified image by the scanner driver 
and the OS, the judgment becomes impossible in case 
10 of employing a scanner driver not supporting the judg- 
ment of the specified image in the foregoing embocfi- 
ment 

[0032] ft Is therefore possible also to provide the OS 
atone with the aforementioned judging function for the 
IS specified image, thereby executing the judgment of the 
image signal obtained in the scanner by the OS itself. 
[0033] As an alternative method for avoiding the 
above-mentioned drawback that the judgment becomes 
impossible in case of a scanner not supporting the judg- 
20 ment of the specified image in the foregoing embodi- 
ment, it is also possible to provkle tiie printer driver with 
the aforementioned judging function for the specified 
image, achieved by the scanner driver in the foregoing 
embodiment, thereby executing the judgment of the 
25 specified image by the OS and the printer driver. 

[0034] More spedfically. in this case, in response to 
the print command entered from the mouse 202 or the 
keyboard 203. the printer driver execute template 
matching on the image signal to be printed, stored in the 
30 memory management module of the OS, thereby judg- 
ing whether the image consisting of the image signal is 
a specified image, and informs the OS of a judgment 
rate con-esponding to tfie result of judgment. 
[0035] According to the result of judgment the OS 
^ eittier destroys the image data or forcedly closes the 
application as in ttie foregoing embodiment 
[0036] Also the template nrray be provkJed in plural 
units for judging plural valuable security documents. 
IP037] Also as an alternative method for avoiding 
0 the above-mentioned drawback that the judgment 
becomes inpossiWe in case of a scanner not support- 
ing the judgment of the specified image in the foregoing 
embodiment it is also possible to refer to tiie version 
information of the scanner driver by the OS. and. if the 
5 scanner driver is identified as not supporting the judg- 
ment of the specified image, to display an operation 
in^age on the monitor 201 for requesting the user to 
download a scanner driver supporting the judgment of 
the specified image through a networi< (for exanple 
? Internet). Also in the aforementioned case where the 
judgment rate is negative, it is possWe to display an 
operation image on the monitor 201 for requesting the 
user to download a scanner driver having tiie forgery 
judgment module. 
• [0038] The scanner driver supporting the judgment 
of the spedf ied image can be downloaded by a manual 
instruction of tiie user in response to such operation 
image. 



BiMsnocir> <FP ifMSfw^? I > 



4 



7 



EP1043 883A2 



8 



[0039] Also in the foregoing embodiment, there 
adopted the template matching on the image signal 
after spatial pixel skipping or after reduction of the 
number of pixels, in order to reduce the judgment proc- 
ess time. g 

[0040] As an alternative method of inaeasing the 
speed of judgment process, there can be adopted a 
configuration of preparing a tenrplate for a part of the 
specified image (for example a watern^ark portion, a 
number portion or a stamp portion in case of a Japa- io 
nese banknote) and transmitting the high judgment rate 
to the OS at a timing when such part of the specified 
image is judged, whereby the judgment can t>e com- 
pleted without judging the entire image signal corre- 
sponding to the specified image but executing the is 
judgment only on the al)ove-mentioned part. 
[0041] Thus the time required for judgment can be 
shortened despite of the judgment process executed by 
a software process. 

[0042] Also an even faster judgment process is pos- 20 
siWe by employing the image signal subjected to spatial 
pixel skipping or reduction in the nunr^jer of pixels as in 
the foregoing embodiment and adopting the above- 
mentioned configuration of utilizing the template corre- 
sponding to a part of the specified image and oulputting 25 
the high judgment rate at the completion of judgment of 
the above-mentioned part instead of executing judg- 
ment on the entire image signal corresponding to the 
specified image. 

[0043] Furthermore, as the probability of finding the 30 
specified image annong the scanned images is gener- 
ally low in most cases, it is possble to execute the 
approximate judgment with such high-speed method, 
and, if the judgment rate is high in such approximate 
judgment, to read the image signal without skipping 35 
from RAM in an image portion corresponding to the 
template in the atxjve-mentloned approximate judgment 
and to execute the fine judgment with a separate tenv 
plate without data skipping prepared for the fine judg- 
ment thereby achieving high-speed judgment and 40 
obtaining secure result for the image which is doubted 
as a specified image. 

[0044] Also, the accuracy of judgment of the speci- 
fied image may be deteriorated if a part thereof is 
employed as the template for judging such specified 45 
image. 

[0045] It is therefore possible to prepare a template 
corresponding to a portion of the specified image and 
another template corresporxfing to another portion of 
the specified image, and. if the judgment rate is high in so 
the judgment employing the former tenrplate corre- 
sponcfing to a portion of the specified image, to execute 
the judgment with the another template (time-shared 
judgment) and to destroy the image data only if the 
judgment rates exceed the threshold values in both tern- ss 
plates, thereby reducing the prot>ability of erroneous 
judgment and realizing highly accurate judgment 
[0046] The foregoing embodiments have been 



explained by fkw charts Indicating the process 
sequence, but the present invention naturally includes 
also a computer readable memory mecfium capable of 
generating in succession codes corresponcBng to such 
process sequence. 

[0047] Also the foregoing embodiments have been 
explained by a configuration of obtaining the image sig- 
nal from the scanner. 

[0048] However the present invention is naturally 
effective also in case of acquiring in^ge signal from var- 
ious input or reproduction devices such as digital cam- 
era, digital camcorder, compact disk, mini disK DVD, 
fOm scanner etc., for executing judgment by the driver 
and OS of such input or reproductfon device as to 
whether such inrage signal belongs to a valuable secu- 
rity docunrtent 

[0049] As explained in tiie foregoing, the above- 
descrfoed configuration is adapted to output a scan 
command to the scanner, to judge whether the image, 
corresponding to the inrage signal obtained from the 
scanner in response to the scan command, represents 
a specified image, and to output the result of judgment 
for use in the processing of tiie image signal. TTierefore, 
for example in a sequence consisting of a scanner, then 
a host computer and a printer, the above-mentioned 
judgment is executed in the most upstream timing of 
acquiring the image signal, thereby securely preventing 
ttie acquisition of tiie image signal corresponding to the 
specified image in a system consisting of a scanner for 
image diata acquisition, a host computer (editing appa- 
ratus) for editing process and a printer for image forma- 
tion. Also there can be achieved high-speed and 
accurate judgment. 

[0050] Also the function of judging the specified 
image can be provided even if the scanner does not 
support the judgo^ent of the specified image. 
[0051] Also the function of judging the specified 
image can be provided corresponding to various input 
devices. 

[0052] Also tiiere is provided an operating system 
capat)le of acquiring the result of judgment indicting 
whether the image signal obtained by scanning repre- 
sents the specified image and executing a process 
according to thus acquired result of judgment, whereby 
the process in the operating system can be securely 
based on the result of judgment of the specified image. 

[Secorxl embedment] 

[0053] Rg. 4 is a view showing the configuration of 
a scanner system including a host computer and consti- 
tuting a second embodiment of the present invention. 
On tf>e host computer, there furxrtions an operating sys- 
tem 1102 (hereinafter written as OS), and a scanner 
operating applfoation 1 1 01 functioning thereon provides 
an operating environment for example for an image 
reading operation of a scanner 1 104. 
[0054] The scanner system shown in Rg. 4 is real- 
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ized by a hardware configuration shown in Fig. 5. 
[0055] Refen-ing to Fig. 5 the scanner system is 
composed of a host conputer 121 and a scanner 122. 
The host computer 121 is provided with a monitor 1201 
for displaying GUI of the application 1 101 and the result 
of image reading from the scanner; a mouse 1202 and 
a keytK>ard 1203 for transmitting the input by the user to 
the application 1 101 and the OS 1102; an HDD 1208 for 
storing various progranre and image data; a FDM 1206 
for storing the basic program of the host computer; a 
RAM 1 205 for storing read programs and images; and a 
scanner l/F 1207 for controlling the scanner 122. which 
are mutually connected by an Internal bus 1209 and 
controlled by a CPU 1204. On the host con^)uter 121 of 
the above-described configuration, the OS 1102 and 
the scanner operating application 1 101 are realized by 
the execution, by the CPU 1204, of the program read 
from the HDD 1208 to the RAM 1205. 
[0056] In the following there will be explained the 
internal structure of the OS 1102 within an extent nec- 
essary for explaining the second entfxxJiment. In most 
OS, like UNIX, there are separately realized a device 
driver for interfecing with the hardware such as the 
scanner, and a module for managing other user applica- 
tions and the memory The present embodiment v«ll be 
explained in the following by an OS having such sepa- 
rate structure. 

[00571 The OS 1102 Is provided, as a module for 
controlling the scanner in addition to controlling the user 
input and other hardware devices, with a scanner driver 
1103. which, in the present embodiment, is provided 
with a scanner control module 1 103-1 for directly con- 
trolling the scanner 1104 and a forgery judging module 
1 103-2 for judging whether the image fetched from the 
scanner is prohibited for r^roduction. The OS is further 
provided with a memory management module 1 105 for 
managing the image data area. 
[0058] The scanner operating application 1101 is 
conposed for example of a GUI routine for interfacing 
with the user, a routine for interpreting the user irput 
received through the OS 1 102 and issuing a command 
for operating the scanner, a routine for displaying the 
image read from the scanner, a routine for storing the 
read inriage on the HDD etc. 

[00591 The scanner 1104 scans and electronically 
reads an original, placed on an original table, by a CCD 
line sensor according to a scanner operation signal from 
the scanner driver 1 103. and sends an image signal to 
the host computer according to a predetermined inter- 
face mle. The image signal is divided into plural cotor 
conrponents. for example R. G and B. each being multi- 
value data of 8 to 12 bits. 

[00601 In the following there will be explained in 
detail the function of . the present embodiment of the 
above-described cwifiguration, with reference to the i 
attached drawings. Rg. 6 shows an example of the 
operation sequence of the scanner system, on the mod- 
ules of scanner operating application 1101, OS 1102 



and scanner driver 1103. 

[00611 When the user instructs a scan start opera- 
tion through the scanner operating application 1101 by 
a manual operation with the mouse 1202 or the key- 

5 board 1203 on the GUI (graphical user interface), the 
scanner initiates the image reading. When the scanner 
operating application starts the reading operation, the 
application secures, on the RAM, an area for the desig- 
nated image to be read in a step SI 301 , then issues an 

10 image reading command specifying the scanner to the 
OS in a step S1302. and then enters a waiting state until 
an image reading end notice is received In a steo 
S1303. 

[00621 In response to the scan start command, the 
15 OS 1 102 calls, in a step S131 1, a scanner driver mod- 
ule corresponding to the specified scanner, then issues 
a command for image reading from the scanner, and 
enters a waiting state until the process of the scanner 
driver 1 103 is temiinated. In tiiis operation, the forgery 
20 preventing module of the OS prepares, as a variaUe, a 
judgment rate representing whether ttie image data are 
of an original forbidden for reproduction. 
[0063] In response to the scan start command from 
the OS 1 102. ttie scanner control module 1 103-1 in the 
25 scanner driver provides, in a step Si 321. the scanner 
witii a scan start command specific to such scanner. In 
a step S1322, after image reading, ttie image signal 
received from the scanner is stored in the image data 
area secured by the application, and the sequence is 
30 transfen-edtothefbrgeryjudgment module 1103-2. 
[0064] The forgery judgment module 1 103-2 is pro- 
vided, as a template, witti a reproduction forbidden pat- 
tern on a memory (RAM or ROM) separate from the 
image memory A step S1323 executes pattern match- 
35 ing between tiie stored image data and the template, 
and outputs a judgment rate of a value between 0 and 
100. An example of such pattern matching consists of 
calculating the nurtual correlation between the image 
data and the template for each color component and 
40 outputting the maximum value of tiie coaelations 
obtained for the different color components, but the 
method of such pattern matching is not particularly 
resfrided. Also the terrplate for the reproduction forbid- 
den pattern may be provided in plural units, and, in such 
is case, the pattern matching is conducted between tiie 
image data and the plural patterns and ttie obtained 
maxOTfUim value can be outputted. In tiie foregoing, the 
forgery preventing module has been explained as a 
software rrxxiule. but it may also be realized by a hard- 
w vrare for faster processing. Also in case of the process 
witfi tiie software module, the process time can be 
shortened for example by (1) preparing a spatially 
skipped image data from the aforementioned image 
data and executing template matching in ttie above- 
5 mentioned forgery judgment module between such 
iniage data and ttie reproduction forbidden pattern (pat- 
tern prohibited for reproduction, con-esponding to ttie 
image data after sidpping). or (2) reducing ttie number 
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of bits of the stored image data and executing template 
matching by the atx3ve-mentioned forgery judgment 
module with the reproduction fortxdden pattem (pattern 
prohibited for reproduction, corresponding to the image 
data after bit number reduction). 5 
[0065] After the image data reading and the forgery 
judging process, the scanner driver informs the OS of 
the end of process and returns the judgment rate 
thereta 

[0066] The OS receives the notice for the end of 10 
process from the scanner driver in a st^ SI 31 2, ard 
discriminates, In a SI 31 3, whether the image data 
are of an image forbidden for reproduction by an actual 
forgery judgment process, tf the judgment rate is larger 
than a threshold value set in advance by the OS, the is 
image data are regarded to have possSDility as an image 
forbidden for reproduction, and the sequence proceeds 
to a step S1314 for forgery preventing control. 
[0067] Rg. 9 is a view showing an example of the 
process flow of the forgery preventirig process SI 31 4. A so 
step S1601 starts the process and a step S1601 dis- 
plays a user input Image as shown in Fig. 7 on a monitor 
1 109 through a display driver 1 107. In this manner, in 
case the image entered from the scanner has the prob- 
ability that it is prohibited for reproduction, the display 25 
asks the user whether he really wants to read the 
inriage. A step SI 602 checks whether the user input is 
"yes" or "no**, and. in case of "yes" (In case of image 
reading), an operatbn history as shown in Ftg. 8 is 
stored in the HDD 1 108. In case of "no" (if inriage read- 30 
ing is canceled), a step Si 603 releases the menrory 
storing the image, thereby prohibiting the image read- 
ing. 

[0068] After the above-descrtt>ed process, a step 
S1315 sends a notice for the end of process to the 35 
application, whereby the image reading operation of the 
scanner system is terminated. 
[0069] In the present embodiment, as explained In 
the foregoing, at the acquisition of the Image signal by 
the scanner, there Is judged the similarity between the 40 
image signal arxj the specffted Image (corresponding to 
a valuable security document such as banknote) and 
the result of judgment can be informed to the operator. 
[0070] Consequently, in case the image prohit^ted 
for reproduction is read just for a mischievous fun of the 45 
operator, an alarm can be given to the operator. 
[0071] However, in case the image reading is exe- 
cuted even after the above-mentioned wamirrg Is given, 
the prevention of the forging action is not sufficient by 
recording the history as explained atxive. so 
[0072] Therefore, in the present embodiment the 
forgery preventing noodule 1106 has a configuration 
capable, in case of storing the intage data, obtained by 
reading the reproduction prohAsited image judged by the 
above-described judgment in the HDD 1 208 of the host 55 
computer 121 , of adding information Indicating that the 
image data represent an Image which is prohibited for 
reproductkxi. 



[0073] Also the printer driver or the printing device 
is given a function of judging such added information 
arvi executes a forgery preventing process such as 
blacking out the formed image, whereby the forging 
action can t>e prevented. 

[0074] Also the added infornnation can be securely 
added to the image data by adopting such an image 
data recording format that the added infornration is not 
renrK3ved even in case the image data are copied an 
exta-na! menrxjry mecfium (such as a floppy disk, an 
optical disk, a mini disk, an MO etc.). Such secure addi- 
tion to the Image data can be achieved by adding the 
infonnation as an cfigital watermark to the image data. 
[0075] Therefore, for example in a sequence con- 
sisting of a scanner, then a host conputer and a printer, 
the above-mentioned judgment is executed in the nrost 
upstream timing of scanning the image signal, thereby 
securely preventing the acquisition of the image signal 
corresponding to the image which Is prohtoited for 
reproduction, in a system consisting of a scanner for 
image data acquisitioa a host computer (editing appa- 
ratus) for editing process and a printer for image forma- 
tion. Also there can be achieved high-speed and 
accurate judgment. 

[0076] Also the printing of the image signal, corre- 
sponding to the Image prohibited for reproduction, can 
be securely prevented, even in case a printer not sup- 
porting the function of judging the specified Image is 
connected, by provkfing the scanner driver or the OS 
with such function of judging the specffied image. 

[Third embodiment] 

[0077] Fig. 10 shows the configuration of a third 
embodiment of the present invention, which executes 
forgery prevention by a printer driver 1703 and an OS 
1702 in an inr^ge processing system consisting of a 
host conrputer and a printer. As in the second embodi- 
ment on the host computer, there functions an operat- 
ing system 1702 (CS), and an application 1701 
functioning thereon provkles an operating environment 
such as an image output operatfon to a printer 1 704. 
[0078] Also as in the scanner system shown in Rg. 
4, the printer system shown in Rg. 10 is realized by a 
hardware configuration shown in Rg, 5. 
[0079] Refemng to Rg. 10, the printer system is 
composed of a host computer 121 and a printer 123. 
The host conputer 121 is provWed with a nx>nitor 1201 
for dsplaying GUI of the applicatfon 1 701 and the result 
of image reading from the scannen a mouse 1202 and 
a k^t>oard 1 203 for transmitting the input by the user to 
the application and the OS; an HDD 1208 for storing 
various programs and Image data; a ROM 1 206-for stor- 
ing the t>asic program of the host computer; a RAM 
1205 for storing read programs and intages; and a 
printer l/F 1210 for controlling the printer 123. which are 
mutually connected by an internal bus 1209 and control- 
led by a CPU 1204. 
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10080] On the host computer 121 of the above- 
described configuration, the OS and the application are 
realized by the execution, by ttie CPU 1204. of the pro- 
gram read from the HDD 1208 to the RAM 1205. The 
OS 1702 is provided, as a module for controlling the 
printer in addition to controlling the user input and other 
hardware devices, with a printer driver 1703, which, in 
the present embodiment, is provided with a raslerizer 
1 703-1 tor generating image data suitable for the printer 
1704. an image memory 1703-2 for storing the gener- 
ated image data, and a forgery judging nrxxlule 1703-3 
for judging whether the rasterized image is prohibited 
for reproduction. The result of forgery judgment, output- 
ted from the forgery judging module, Is transferred to a 
forgery prevention control module 1705, which in 
response executes a process for prevertting or sup- 
pressing the forging action. 

[0081] The OS 1702 is also provided witii a print 
spooler 1 709 for executing control for outputting the ras- 
terized image to the printer. In the foregoing, the raster- 
izer, image memory and forgery judging module are 
supposed to be executed by ttie printer driver, namely 
realized by a software process, but these may be also 
executed in the printer 1704. In such case, the result of 
forgery judgment executed in the printer may be 
returned to the forgery prevention control module 1 705. 
[0082] In the following there will be explained the 
flow off the forgery preventing process in the present 
embodiment. 

[0083] In response to a print start command 
entered by a manual operation witti the mouse 1202 or 
the keytoard 1 203 on the GUI (graphical user interface) 
displayed on the monitor 1708, tiie OS 1702 instructs 
the printer driver 1703 to print the data received from 
the application 1701. In response to the print instruc- 
tion, the printer driver 1 703 causes the rasterizer 1 703- 
2 to develop tiie document to be printed as image data 
and stores the image data in the image memory 1703- 
2. The stored image is transferred to the forgery judging 
module 1703-2 and the print spooler 1709, which 
respectively start the forgery judging process and the 
printing process. The forgery judging nxxiule judges, as 
in the second enr±KxJiment. whether the inrage to be 
printed includes a pattern prohMed for reproduction, 
and serxls tiie judgment rate to tiie forgery prevention 
control module 1705. which compares the threshold 
value set in advance by the OS wrth the judgment rate, 
and, if the latter is larger, cfispiay an alarming dialog as 
shown in Rg. 7 on the monitor 1708. If the user decides 
not to execute printing in response to the cfisplayed dia- 
log, a spooGng interruption commarxJ is sipplied to the 
printer spooler 1704 to terminate the printing process. 
In case the user decides to execute printing in response 
to the displayed dialog, an operation history information 
as shown in Fig. 8 is stored in 1706 whereupon the 
printing process is terminated. 
[0084] For a high judgment rate, the forgery pre- 
venting module may display inten-uption of printing on 



tiie monitor 1 708 and issue a spooling interruption com- 
mand to the printer spooler 1704, instead of alarm dis- 
play. 

[0085] In tiie present embodiment there has been 
5 explained a configuration in which the host computer 
and the printer are connected in a one-to-one relation- 
ship, but the forgery judgment may also be executed by 
tiie OS including tiie printer driver, in a configuration 
where plural host computers are connected to a printer 
10 through a network. 

[0086] The forgery judging configuration adopted in 
tiie printer allows to juc^e tiie forgery in the same man- 
ner as in tiie OS. 

[0087] However, the network printer is ocopied 

15 during the judgment off the image data representing the 
image prohibited for reproduction, and such sitiation is 
undesirat)le for tiie operators of other host computers. 
[0088] On the ottier hand, ttie forgery judgment 
executed in the OS is effective in preventing unneces- 

20 sary occupation off tiie printer. 

[0089] Also the forgery judgment in tiie OS realizes 
secure prohibition of reproduction even in case of 
empbying a printer not supporting ttie function of judg- 
ing the image prohibited for reproduction. 

25 [0090] In the foregoing second and tiiird embodi- 
ments there has not been explained the number off tem- 
plates, but it is also possible, in tiiese embodiments, to 
prepare plural templates corresponding to tiie valuable 
security documents of ^plural kinds, thereby judging 

30 such documents of plural kinds. 

[0091] Also as an alternative method for avoiding 
tiie above-mentioned drawback that tiie judgment 
becomes impossible in case of a scanner (or printer) 
driver not supporting the judgment off tiie specified 

35 image in ttie foregoing embodiments, it also possible 
to refer to the version information off the scanner (or 
printer) driver by tiie OS, and, if tiie scanner (or printer) 
driver is identified as not supporting the judgment of tiie 
specrffied image, to display an operation image on tiie 

40 monitor 1201 for requesting tiie user to download a 
scanner (or printer) driver supporting the judgment of 
the specified image through a network (for example 
Internet). 

[0092] The scanner (or printer) driver supporting 
45 tiie judgment of the specified image can be downloaded 
by a manual instruction of the us^ in response to such 
operation image. 

[0093] Also in the foregoing embodiment tiiere is 
adopted the template matching on the image signal 
50 after spatial pixel skipping or after reduction off the 
number off pixels, in order to reduce the judgment proc- 
ess time. 

[0094] As an alternative method of increasing the 
speed of judgment process, ttiere can be adopted a 
55 configuration of preparing a template for a part of the 
specrffied image (for exanple a watermart^ portion, a 
number portion or a stamp portion in case of a Japa- 
nese banknote) and transmitting tiie high judgment rate 
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to the OS at a timing when such part of the specified 
image is judged, whereby the judgment can be com- 
pleted without judging the entire image signal corre- 
sponcfing to the specified image but executing the 
judgment only on the above-mentioned part. 5 
[0095] Thus the time required for judgment can be 
shortened despite of the judgment process executed by 
a software process. 

[0096] Also an even faster judgment process is pos- 
sible by employing the image signal subjected to spatial 10 
pixel skipping or reduction in the number of pixels as in 
the foregoing embodiment and adopting the above- 
mentioned configuration of utilizing the template corre- 
sporxJing to a part of the specified Image and outputting 
the high judgment rate at the completion of judgment of is 
the abcve-merrtioned part, instead of executing judg- 
ment on the entire image signal correspondng to the 
specified image. 

[0097] Furthermore, as the prctobility of finding the 
specified image anfX)ng the scanned images is gener- 20 
ally low in most cases, it is possa>le to execute the 
approximate judgment with such high-speed method, 
and, if the judgment rate is high in such approximate 
judgment, to read the image signal without skipping 
from RAM in an image portion corresponcfing to the 2S 
template in the above-mentioned approximate judgment 
and to execute the fme judgment with a separate tenrv 
plate without data skipping prepared for the fine judg- 
ment thereby achieving high-speed judgment and 
obtaining secure result for the inrage which is doubted 30 
as a specified image. 

[0098] Also, the accuracy of judgment of the spech 
fied image may be deteriorated if a part thereof is 
employed as the tenplate for judging such specified 
image. 35 
[0099] It is therefore possible to prepare a template 
corresponding to a portion of the specified image and 
another template corresponding to another portion of 
the specified image, and, if the judgment rate is high in 
the judgment employing the former template corre- 40 
sponding to a portion of the specified image, to execute 
the judgment with the another template (time-shared 
judgment) and to destroy the image data only if the 
judgment rates exceed the threshold values in both tenv 
plates, thereby reducing the probability of erroneous 45 
judgment ar>d realizing highly accurate judgment 
[0100] The foregoing embodiments have been 
explained by fk>w charts indicating the process 
sequence, but the present invention naturally includes 
also a conrputer readable memory medium capable of so 
generating in succession codes corresponding to such 
process sequence. 

[0101] Also the foregoing embodiments have been 
explained by a configuration of obtaining the image sig- 
nal from the scanner. 55 
[0102] However the present invention is naturally 
effective also in case of acquiring image signal from var- 
ious input or reproduction devices such as digital canrv 



«a. digital camcorder, compact disK niini disK DVD, 
fam scanner etc., for executing judgment by the driver 
and OS of such input or reproduction device as to 
whether such image signal belongs to a valuable secu- 
rity document 

[0103] As explained in the foregoing, there can be 
provided the function of juc^ing the specified image, 
even if the printer does not support the judgment of the 
specified image. 

[0104] Also there can be provided the function of 
judging the specified image, corresponding to various 
input devices. 

[0105] Also there is provided an operating system 
capable of acquiring the result of judgment indicating 
whether the image corresponding to the image signal 
obtained by a print instruction represerrts the specified 
image and outputting a signal for executing a process 
according to thus acquired result of judgment, whereby 
the process ri the operating system can be securely 
based on the result of judgment of the specified in^ge. 
[01 06] Also the foregoing embodiment is adapted to 
send an image signal generation commarKd to an input 
device, to judge whether the image coresponding to 
the image signal obtained from the input device in 
response to the above-mentioned command represents 
a specified image, and to output a signal for displaying 
the result of the judgment on the display unit whereby 
the operator can be informed of the result of the judg- 
ment whether the image corresponding to the image 
signal represents a specified image. 
[01 07] Also the foregoing embodiment is adapted to 
judge whether the image corresponding to the image 
signal represents a specified image, and, if the judg- 
ment iderrtifies that the above-mentioned image is a 
specified image, to add infomration indicating that the 
above-mentioned image is a specified image, in storing 
thus judged image data, so that the information can be 
added at the storage of thus judged imaga Such infor- 
mation can be added also at the storage of the judged 
image in a memory medium. 

Claims 

1. An image processing method for use in a scanner 
driver, comprising steps of: 

outputting a scanning command to a scanner; 
judging whether an in^ge corresponding an 
image signal obtained from the scanner in 
response to the commarxi represents a speci- 
fied image; and 

outputting a result obtained in said judging step 
so as to use the result in a processing of the 
image signal. 

2. A method according to claim 1. wherein said out- 
putting step outputs to an operation system execut- 
ing the process on the image signal according to 
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the result obtained in said judging step. 

3. A method according to daim 1 , wherein said judg- 
ing step executes judgement using tenplate match- 
ing. 

4. A method according to claim 1, wherein a process 
of obtaining the image signal from the scanner is 
executed by a scanner module, and the process of 
judging whether the image corresponding to the io 
image signal represents the specified image is exe- 
cuted by a forgery preventing module. 

5. A method according to daim 1. wherein said judg- 
ing step executes judgement on the image corre- is 
spending to the image signal arxJ plural specified 
Images. 

6. A method according to daim 1 , wherein said judg- 
ing step executes judgement with an Image signal so 
obtained by spatial thinning of the image signal. 

7. A method according to claim 1 . wherein said judg- 
ing step executes judgement executed with an 
image signal obtained by reducing the number of 25 
bits of the image signal. 

8. A method according to claim 1. wherein said judg- 
ing step terminates judgement when there is 
obtained a high judgment rate indicating that the 30 
image corresponding to the image signal obtained 
from the scanner represents the specified inrage. 

9. A method according to daim 1 , wherein said judg- 
ing step executes judgement with an in^age signal 35 
obtained by spatial thinning of the image signal, 
and, if the result obtained in said judging step indi- 
cates a high probability of a specified image, said 
judging step executes judgement with the image 
signal without thinning. 40 

ia A method according to claim 9, wherein said judg- 
ment with the unthinned image signal is executed 
by using only the image signal in an area containing 
an object of judgment within the thinned image sig- 4S 
nal. 

11 . A method according to daim 1 , wherein said judg- 
ing step execute second judgement when a high 
judgment rate is obtained in a first judgment in two so 
kinds of judgements provided for a same specific 
image. 

12. A computer readable memory medium which 
stored codes for executing the method according to ss 
daim 1. 

13. An operating system for obtaining a result of judg- 



ment indicating whether an image corresponding to 
an image signal obtained by scanning represents a 
specified image; and 

executing a process according to the obtained 
result of judgment. 

14. An operating system according to claim 13. wherein 
said judgment is executed in a scanner driver. 

1 5. An operating system according to claim 14, wherein 
information indicating whether said judgment has 
been executed is obtained from said scanner driver. 

16. An operating system according to daim 13. wherein 
said process is a working on said image signal. 

1 7. An operating system according to claim 1 3. wherein 
said process is a process of ending an application 
functioning on said operating system. 

18. An image processing method for use in an input 
device comprising steps of: 

outputting an image signal generating com- 
mand to an input device: 
judging whether an image corresponding to the 
image signal obtained from said input device in 
response to said command represents a spec- 
ified image; and 

outputting a result obtained in said judging step 
for use for a process off said image signal. 

19. A method according to daim 18, wherein said input 
device is a digital camera, a digital camcorder, a 
tnm scanner, a compact disk, a minicfisk or a D\^D. 

20. A computer readatrfe memory medium which 
stored codes for executing the process according to 
daim 18. 

21. An image processing method for use in a printer 
driver comprising the steps of: 

recaving an instruction for a printing process; 
judging whether an image conresponding to an 
image signal developed represents a specified 
image according to the printing process; and 
outputting a result obtained in said judging step 
so as to use the result in a process off said 
image signal. 

22. An image processing method for use in a printer 
driver according to daim 21 , 

wherein a forgery preventing module in an operat- 
ir>g system outputs an instrudion for executing a 
predetermined display to a display driver according 
to the result obtained in said judging step. 
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23. An image prcx;essing method for use in a printer 
driver accorcfing to daim 21 . 

wherein a forgery preventing module in an operat- 
ing system outputs an instruction for terminating a 
spooling operation according to the resutt obtained 5 
in said judging step. 

24. An image processing method for use In a prints 
driver according to daim 21 , 

wherein said judging step execute judgement using 10 
template matching. 

25. An image processing method for use in a printer 
driver according to daim 22, 

wherein said predetermined display indicates that is 
the image is an image off which reproduction is 
inhibited. 

26. An image processing method for use in a printer 
driver accorcfing to daim 25» 20 
wherein when an instruction for printing ts issued 
after the display, log infornration is stored in mem- 
ory means. 

27. An image processing method for use in a printer 25 
driver according to daim 21 , 

wherein said judging step executes judgement for 
an image con-esponding to the image signal and 
plural specific images. 

30 

28. An image processing method for use in a printer 
driver according to daim 21 , 

wherein said judging step executes judgement with 
an image signal ok>tained by spatial thinning of the 
image signal. 35 

29. An image processing method for use in a printer 
driver accorcfing to daim 21 , 

wherein said judging step executes with an image 
signal obtained by reducing the number of bits of 40 
the image signal. 

30. An image prcx;essing method for use in a printer 
driver accorcfing to daim 21 , 

wherein said judging step terminates when there is 45 
obtained a high judgment rate indicating that the 
image corresponding to the obtained image signal 
is a specific image. 

31. An image processing method for use in a prints so 
driver accorcfing to daim 21 , 

wherein, said judging step executes judgement with 
the Image signal obtained by spatial thinning of the 
image signal, when a result of the judgem&it indi- 
cating a high probability of a specific image, said ss 
judging step executes judgment with the in^ge sig- 
nal without thinning. 



32. An inrage processing method for use in a printer 
driver according to daim 30, 

wherein said judgment with the unfhinned image 
signal is executed with only the in^ge signal of an 
area containing an object of juc^ent in the thinned 
image signal. 

33. An image processing niethod for use in a printer 
driver according to claim 31. 

wherein said judging step executes second judge- 
ment when a high judgment rate is obtained in first 
judgment in two kinds of judgements provided for a 
same specific image. 

34. A cx>mputer readable memory medium which 
stored codes for executing the method according to 
daim 21. 

35w An operating system for: 

obtainng a result off a judgment whether an 
image corresponding to an image signal 
obtained according to a print instruction repre- 
sents a specific image; 

outputting a signal for executing a process 
according said obtained result off judgment 

36. An operating system accorcfing to claim 35, wherein 
said judgment is executed in a printer driver. 

37. An operating system accorcfing to claim 35, wherein 
said process is a process for terminating the print- 
ing of the image corresponding to said image sig- 
nal. 

38. An operating system according to daim 35, wherein 
said process is a process for displaying that said 
image is a specified image. 

39. An image processing method for use in a driver 
comprising the steps of: 

outputting an image signal generating com- 
marxl to an input devicie; 
judging whether an image corresponcfing to the 
image signal ot>tained from said input device in 
response to said cx)mmand represents a spec- 
*rf ied image; and 

outputting a signal for causing a display unit to 
displ^ a result obtained in said judging step. 

40. An image prcx^essing methcxl for use in a driver 
according to daim 39, wherein sasd input device is 
a digital camera, a cfigital camcorder, a scanner, a 
compact disK a mini disk, ex a DVD. 

41. An image processing method comprising steps of: 
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judging whether an image corresponding to an 
image signal represents a specific image: and 
adding information indicating that said image is 
the specific image, to said image signal if 
image data of two image judged as ^ecific s 
image is stored when said judgment identifies 
that said image is a specified image. 

42. A method according to claim 41. wherein said 
added information can be recognized by a printer io 
driver or a printer. 

43. A method according to claim 41. wherein said 
added information is also copied when image signal 

is copied to a memory medium. is 

44. A method according to claim 41, wherein said 
added information is added as a digital watern^rk 
to the image signal. 

20 

45. A scanner adapted for outputting an image Signal to 
the scanner driver according to claim 1 . 

46. A printer adapted for printing an image from the 
prirrter driver according to claim 21. 25 

47. A computer processing apparatus storing program 
instructions defining an application, an external 
device driver, and an interface between the applica- 
tion and the device driver, wherein the device driver 3o 
IS arranged to determine whether image data 
from/to the external device represents a predeter- 
mined image, and the internee is arranged to con- 
trot processing of the image data in dependence 
upon the determination result. 35 

48. Apparatus accorcfing to claim 47. wherein the inter- 
face is part of an operating system. 

49. Apparatus according to claim 47 or daim 48 4o 
wherein the external device is an image reading 
device. 

sa A conputer program product for use in an appara- 
tus according to claim 47. comprising instructions 4s 
defining an external device driver, the ir^ructions 
including instructions for causing the driver to deter- 
mine whether image data represents a predeter- 
mined image. 

• so 

51. A computer program product for use in an appara- 
tus accordng to claim 47. comprising instructions 
defining an interface, the instructions including 
instructions for controlling processing of image data 

in dependence upon whether the inrage data repre- 55 
sents a predetermined inr^ge. 

52. A conrputer program product according to daim 50 



or daim 51. when enrixxlied as a signal conveying 
the instructions. 
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